Skip to content

Final report #773

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 65 commits into from
Jul 11, 2025
Merged

Final report #773

merged 65 commits into from
Jul 11, 2025

Conversation

dcoutts
Copy link
Collaborator

@dcoutts dcoutts commented Jul 1, 2025

The final write-up for the project.

We should probably also include .pdfs of some of the references (the preceding reports), and it'd probably be helpful to include a generated pdf of the final report and the integration notes.

Copy link
Collaborator

@jorisdral jorisdral left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks very good! I have a bunch of comments but mostly just clarifications

@jeltsch
Copy link
Collaborator

jeltsch commented Jul 8, 2025

it'd probably be helpful to include a generated pdf of the final report and the integration notes

Hmm, generated files shouldn’t be in a repository if the sources are there, right? We may easily get inconsistencies. We might put the generated PDFs at some sensible place on the web. Also generating them oneself shouldn’t be that hard. One needs Pandoc, of course, but that’s basically it. By the way, I recently added a makefile to doc/final-report, not least to document the command lines used to build the PDF files.

@jeltsch jeltsch force-pushed the dcoutts/final-report branch from a34545b to 6538634 Compare July 8, 2025 20:43
@dcoutts
Copy link
Collaborator Author

dcoutts commented Jul 10, 2025

Hmm, generated files shouldn’t be in a repository if the sources are there, right?

In theory no, in practice yes. It's for convenience of readers. They're simply not going to go generate the pdf. Not only does it involve installing pandoc, but also a dozen or more texlive packages. And apparently there's no way to declare which textlive packages are needed: one just has to iterate: make, fail, install, repeat. It's a 5 minute job at minimum (if you know how to do it), for something readers expect to take 1 second.

dcoutts added 21 commits July 11, 2025 13:11
No need to be .SILENT. It's helpful feedback to see what it did, what
files it made.
Have to change the markdown format of the table to be able to use
multi-row headers.
and its effect in the parallel scaling on the affected machines.
Use no disk caching, since that makes things more interesting.

Use a much smaller write buffer. Otherwise the number of elements was
80k and the write buffer was a quater of that at 20k, which corresponds
to just four runs. That doesn't allow for much run merging, which makes
things less interesting. By using 1k for the write buffer, we get 80
runs inserted (or more for the benchmarks that use multiple iterations).
Admit we're just giving a high level summary and cite our own previous
work for a full detailed treatment.

Also improve the explanation of the pipelining diagram.
@dcoutts dcoutts force-pushed the dcoutts/final-report branch from 0d0cded to 3430b87 Compare July 11, 2025 12:11
@dcoutts
Copy link
Collaborator Author

dcoutts commented Jul 11, 2025

I think we're done. Phew!

@dcoutts dcoutts enabled auto-merge July 11, 2025 12:12
@jeltsch
Copy link
Collaborator

jeltsch commented Jul 11, 2025

Hmm, generated files shouldn’t be in a repository if the sources are there, right?

In theory no, in practice yes. It's for convenience of readers. They're simply not going to go generate the pdf.

Well, we could put the PDF files on the web, just not into the repository. I found GitHub Actions to be quite good for this, not least because it guarantees consistency between source and build product.

That said, I don’t want to push anything for this particular case but just provide an idea. 🙂

@dcoutts dcoutts added this pull request to the merge queue Jul 11, 2025
Merged via the queue into main with commit c1bbd81 Jul 11, 2025
30 checks passed
@dcoutts dcoutts deleted the dcoutts/final-report branch July 11, 2025 13:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants